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Abstract. For 1 < g < n — 2, we provide explicit examples to demonstrate 
non-compactness of the Neumann operator for the Kohn Laplacian acting on 
(0, 5)-forms on the unit ball in (2n + l)-dimensionaI Heisenberg space. 



1. Introduction 

The purpose of this short note is to fill a missing gap in the literature. In an 
otherwise excellent paper, Shaw [9 claimed to demonstrate non-compactness for 
the Neumann operator iVf, for the Kohn Laplacian acting on (0, l)-forms on 
the Heisenberg ball with Neumann boundary conditions. However, the inequality in 
the second displayed equation of [9li p. 162] is incorrect and the argument is invalid. 
Indeed, as we shall see below, the argument cannot be easily fixed. 

The Kohn Laplacian is a formally self-adjoint, second order differential opera- 
tor associated to the tangential Cauchy-Riemann operator 9b on Cauchy-Riemann 
manifolds. It provides a natural sub-elliptic analogue to the elliptic complex Lapla- 
cian on complex manifolds. On closed manifolds the qualitative properties, such as 
regularity and existence of solutions, of both operators are similar [3l |4]. However, 
on bounded domains the Kohn Laplacian exhibits significantly worse behavior. For 
domains with sufficiently nice boundaries, the Neumann operator for the complex 
Laplacian is known to be compact, see for example [l][2l[3]. Despite the failure of 
the argument in [5] , the converse has been widely believed for the Kohn Laplacian. 
In this note we shall provide a new argument to verify this. 

As with many non-compactness arguments, the idea in [3] was to construct a 
bounded orthogonal sequence {au) such that (Ntak) contains no convergent sub- 
sequences. The c?b-Neumnan problem on bounded domains, and on the Heisenberg 
ball in particular, has been studied in detail by the author [SIITIIH]- The idea was 
to study a degenerate foliation of the Heisenberg ball by spheres and decompose 
□b into pieces transverse and tangential to this foliation. The tangential pieces 
could be expressed in terms of the Kohn Laplacian on the standard unit sphere 
and decomposed into eigenspaces. The sequence constructed in [9] obtained its 
orthogonality by projecting onto different eigenspaces on the leaves of the foliation. 
Unfortunately the eigenvalues associated to such a sequence will converge to infinity 
and it follows that if (at) is bounded then (iVf,afc) must converge to 0. To construct 
a sequence contradicting compactness, it is essentially necessary to work within a 
single eigenspace on the foliating spheres. Thus an entirely different method of 
constructing the sequence is required. 
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Here we shall instead show that there is a funetion A and infinite dimensional 
subspace of forms with the property that \I\bU — Xu. We shall then be able 
to provide a contradiction to compactness of Nf, using sequences from within this 
subspace. 

2. Definitions and theorem 

The 2n + 1 dimensional Heisenberg group is the manifold H" = Rt x C" equipped 
with the CR-structure L defined as the complex linear span of the vector fields Lj = 
dzi + izjdt, j — 1, . . . ,n. The Heisenberg groups are equipped with a anisotropic 
family of dilations 5r{t, z) — {r'^t, rz) that preserve L and a dilation-norm \\ {t, z)\\ — 

{t^ + \z\'^y^'^. The bundle L and its conjugate L are annihilated by the contact 
form Tj — ^ i^dt — iz^dz^ + iz^ dz^^ . 

We define a functions w: H" — > C and H" — > M by w = t+^lzp and q = 1— |wp 
respectively. The closed unit ball in H" is given by 

n = {{t,z) e H": ||(t,z)|| < 1} = {\wf < 1} = {g>0}. 

A {p, g)-form on H" is a differential form of type 

f = Y.failV''^dz'AdzJ 

where a, /, J are multi-indices with a G {0, {!}}, |a| -I- |/| = p and | J| = q. The db 
operator on H" is then defined on smooth {p, g)-forms by 

dbf = (Lkfaij) dz'' Arj^'A dz' A dz'' . 

We shall be concerned with db acting on the space of (0, g)-forms on ft. Ac- 
cordingly, we extend db to be the maximal extension of db to a linear, closed 
and densely-defined operator Ljp^j(Jl) — Lj^ ^^^^{n). We denote by and d,, 
the formal adjoint and L^-adjoint of db respectively. It is easy to verify from an 
integration- by-parts argument that a smooth form u e Dom (j^b^ ^'^'^ ^^ly 

(1) dbgVu^O ondn. 

The Kohn Laplacian Db on the unit ball is the unbounded operator on L^^ (fi) 
defined by 

(2) 

Dom (Db) = {u € Dom (db^ ^ Dom (^db) ■ dbu G Dom ^9^^ , di^u G Dom (9f,)}, 
(3) Db = dbdl +dldb. 

It was shown by Shaw in [5] that is a closed, densely-defined self-adjoint operator. 
It also follows from the work of [S] that for p = and 1 < g < n—2 there is a bounded 
Neumann operator Nb ■ Lj^^ q){^) ~^ Dom (□{,) C L^g q)(^) ^'^^h that DbNb = Id on 
^^{n) and NbDb = Id on Dom (Db). 
To describe the boundary conditions for sufficiently smooth forms, we first fix 
s = jzp so w = t + is. Then dbp = iz^dz^. Thus if we define Y :— z'^Lj., the 
boundary condition dU) can be written 



(4) 



Yju = on dn. 
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Now for a multi- index J with | J| = g + 1, wc define a (0, g)-forin 

fceJ 

A straightforward computation shows that Kj^'^ = everywhere. 

Lemma 1. Suppose 1 < q < n — 2 and h is any holomorphic function on an open 
set of C containing the unit ball. Let J = {1, . . . , g + 1} and define a (0, q)-form by 

Then for sufficiently large I, Uh G Dom{^b) and 

{q + l){n + l-q-l) 

UbUh Uh. 

s 

Proof. Now, as noted earher, it is easy to see that Y_iUh = 0. Furthermore 

dbUh = -{q + l)s-^z^dz^ A Uh + {q+ l)h{w){z'')h~^'i+^Uz^ A • • • A 

As Y _idz^ A • • • A dz''^^ = we also have Y_idbUh = 0. Now for very large 
I » 2{q + 1), Uh is in C^(ri) and hence Uh & Dom (□&). 

We can now use the usual formula of Folland and Stein [5] that on sufficiently 
smooth (0,(7)-forms 

Dbifidz') = -J2{LkL-Jj) dz' - J2iL-kLkfi) dz'. 

k^l kel 

For the (0, g)-form Uh and I < k < q + I, we have 



MAk = i-^r'hMyT 



By direct computation, we see that for j ^ J\k and q + 1 < m < n 

L-jLj {h{w)s-'') = ih'{w)s-'^''+^^ {s - az^z') + ah(w)s-'^''+^\{a + l)z^z^' - s), 
Lfcifc {h{w)z''s-') = ih'{w)s-^''+^h^{s ~ az^z'') 

+ ah{w)s-^''+^h''{~2s + {a + l)z''z''), 

L,nLrn {h{w)s-'') ^ -iah' {w)s- z''" 

+ ah{w){z"'ys-^''+^\{a + - s), 

L^Lf, (/i(u;)(z")'s-") ^ -m/t'(w)s-(''+i)(z")'+iz" 

+ a/iH(z")'s-("+^)((a + l)z"z" - s{l + 1)). 
From this it is easy to see that 

(M-)(-")',,.A.-) . --^'Hf)' + . - as) 

-^^^^^0^{{a + l)s-qs~2s^in-q-2)s-il + l)s). 
The required identity is a simple consequence of the case a — q + 1. 

□ 

We can now prove our non-compactness result. 
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Theorem 1. If 1 < q < n — 2, the Neumann operator Nb on L'^^ ^^(fl) is not 
compact. 

q+l „ 

Proof. First fix ^ >> and note that {uh^,Uh^) = ^3^|z"p ^ \z''\ . Let £> = 

* fc=i 

9+1 

{C e C: Id < l,Im(C) > 0} and set uj ^ J^^„_, |z"|2' ^ z^z^da where §^"-1 is the 

k=l 

unit ball in C'^". Then if we switch to polar coordinates (and recall that s = |zp 
rather than |z|), we see that, for some constant C > independent of h, 

(5) \\u,\\l^ ,n)^CLoj |MC)|^"+'-2'-idyz. 

where we also use s to denote Im(C). For convenience, we renormalize the norm on 

^(0 q) ^^^^ '-^^ ~ ^ ■ 

Now choose hkiC) = V8fc + 2C^'= and let K = {re'^ 1/2 < r < l,7r/4 < 6* < 
37r/4}. Then it is easy to see that for fc > j > 0, hj and hk are orthogonal on 
L^{K) and so 

\h, - h/dVo - \h,f + \h/dVD > J + 5 = f • 



From this it follows that 




Furthermore, since I has been chosen to be very large, s""*"' < 1 on £). Thus 

(7) \\s~W\\l.^ ^^(f,) < \hiC)\' s^+^-'^-'dVo < \h{0\^ dVo < 27r. 

Now Uh^ is a sequence of forms in C^q n Dom(n6). By ^ there are no 

convergent subsequences in L^^ q){^)- By Lemma [1] and ([7]), the sequence DfeU/ifc is 
bounded in I* follows trivially that A^b is not compact. 

□ 

One consequence of this theorem is that the range of Nb cannot be contained in 
any positive Sobolev space H'^{n) as Nb would need to be compact by the RcUich 
Lemma. Thus solutions to DbU = / do not globally gain in Sobolev regularity on 
the Heisenberg ball. Gains in weighted regularity are described in [HI [3 |S] . 

As a final remark, we note that the Heisenberg ball has two characteristic bound- 
ary points, (±1,0) where the distribution L is tangent to the boundary. The pres- 
ence of characteristic points typically complicates any analysis of db or on the 
domain. However, this is not a contributing factor to Theorem [1] Indeed, an al- 
most identical argument could be applied to the domain — 2i| < 1} which has 
completely non-characteristic boundary. 
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